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THE  SITUATIONAL  INTERVIEW: 

EXAMINING  WHAT  PEOPLE  SAY  VERSUS  WHAT  THEY  DO  VERSUS  WHAT  THEY  HAVE  DONE 


Abu  tract: 

Two  studies  were  conducted  to  east  the  validity  of  the  situational 
interview.  In  the  first  study  a  concurrent  validity  ch-red  that 

there  is  a  correlation  between  what  people  in  cm  interview  setting  £sy 
they  dc  on  the  job  and  what  they  actually  do  ou  the  job  us  rnpoi«.ad  by 
both  peers  and  supervisors.  Furthermore,  a  situations l  approach  to  inter¬ 
viewing  appcarc  pre 'ierc'i.-Ie  to  nski  ._.  people  direct  questions  at  out  their 
y«?r  axpet-5 :  nct-s .  tecoad  study  used  a  ptcdictiic  validity  ste<:t«y 

test  the  theoretical  precise  of  the  situation  cl  interview*  naiue.t/,  that 
intentions  predict  behrvior. 
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THE  SITUATIONAL  INTERVIEW: 

‘ . EXAMINING  WHAT  PEOPLE  SAY  VERSUS  WHAT  THEY  DO  VERSUS  WHAT  THEY  HAVE  DONE 

One  of  the  most  frequently  documented  failures  in  the  Industrinl- 
organlzatlonal  psychology  literature  Is  the  Inability  of  the  selection  inter¬ 
view  to  identify  who  is  likely  to  perfora  a  job  in  a  satisfactory  manner 
(Miyfield,  1964;  Ulrich  l  Trumbo,  1966;  Vagner,  1949).  Much  research  time 
and  effort  was  er.per.ded  in  the  196C'a  an.i  early  1970's  documenting  vhy  the 
Interview  yields  disappointing  results  as  a  selection  device  (e.g.,  l'akel, 
Dobmeyer  &  Dunnette,  1970;  Webster,  1914;  Wsxley ,  Yukl,  Kovacs  &  Sanders, 
1972). 

Little  research,  however,  has  been  done  recently  to  improve  the  validity 
of  the  selection  interview  (Tenopyr  &  Oeltjen,  1982).  One  early  study  which 
did  demonstrate  the  effectiveness  of  an  interview  procedure  was  conducted  by 
Ghlselll  (1966).  This  procedure  involved  aching  Interviewees  specific  ques¬ 
tions  about  their  past  experiences.  Using  this  method,  Ghlselll  was  able  to 
predict  successfully  the  job  tenure  of  stock  brokers  (r  ■  .35). 

Ghisclli's  procedure  was  us  follows:  The  interviewer  was  given  no 
information  about  t':-?  interviewee  except  the  person’s  name  and  the  branch 
office  for  which  the  applicant  was  being  considered  as  an  employee.  Each 
interviewee  was  asked  what  he  or  she  had  dene  (e.g.,  what  college  had  been 
attended),  why  it  had  been  done  (e.g.,  why  a  particular  branch  of  the  mili¬ 
tary  had  bean  chosen),  what  duties  the  person  had  performed  in  various  jobs, 
and  how  veil  the  person  had  performed  them.  Finally,  the  applicants  were 
asked  why  they  wanted  to  become  a  stockbroker,,  what  they  thought  about  the 


4 


job,  and  what  they  thought  they  would  derive  from  It. 

It  should  be  notsd  that  questions  of  a  personal  nature  were  not  asked. 

If  an  interviewee  volunteered  information  of  a  personal  nature  (c.g.,  rela¬ 
tionships  with  parents  or  spouse,  religious  and  political  preferences, 
childhood  experiences)  the  Individual  was  told  that  the  Information  was  not 
pertinent  to  the  interview. 

In  suznnary,  Ghiselli's  procedure  ia  a  method  for  collecting  informatiej 
about  a  person’s  past  experiences  to  predict  the  person's  work  behavior. 

The  only  "inferential  luxury"  he  allowed  himself  was  based  on  his  estiante 
of  what  each  person  knew  oi  the  job  opening.  He  hypothesized  correctly  that 
people  who  know  what  they  are  "getting  into"  are  more  likely  to  be  more 
successful  than  people  who  lack  this  knowledge. 

In  a  comprehensive  reviaw  of  the  literature,  Tenopyr  and  Oeltjen  (1982) 
found  that  one  of  the  few  interview  procedures  other  than  Ghiselli's  that 
successfully  predicts  perfonaar.ee  is  the  situational  interview  (Latham,  Saari, 
Pursell  a  Campion,  1980).  Whereas  Ghiselli's  method  is  based  on  a  fundamental 
axiom  of  psychology,  namely ,  that  past  behaviors  are  among  the  best  predictors 
of  future  behaviors,  the.  situational  interview  is  based  on  the  premise  that 
a  person's  behavior  is  related  to  his  or  her  present  goals  or  intentions. 

The  two  procedures  are  similar  in  that  a  person's  past  experiences 
undoubtedly  affect  responses  to  interview  questions  regardless  0f  the  format. 
In  both  procedures  quer cions  of  s  personal  nature  are  avoided.  Finally,  both 
procedures  incorporate  implicitly  the  importance  of  a  realistic  job  preview 
(Wanoua,  1980).  Chisclll'e  procedure  ascertains  the  extent  to  which  an 
applicant  has  acquired  knowledge  of  the  job  prior  to  the  interview;  Latham 
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•t  al.'s  procedure  provides  this  Information  to  the  interviewee  through  the 
questions  thcuselves .  That  is,  the  questions  are  derived  from  a  systematic 
job  analysis,  nanely,  the  critical  incident  technique  (Flanagan,  1954).  The 
questions  are  based  directly  on  incidents  or  situations  that  were  identified 
in  the  job  analysis.  The  applicant  is  told  that  the  situations  are  those 
that  a  job  incumbent  could  expect  to  encounter  frequently.  The  following 
two  Incidents  should  illustrate  this  point. 

(1)  Near  the  end  of  your  shift  you  are  moving  through  the  plant  to  clean 
an  area  your  supervisor  has  told  you  is  badly  in  need  of  cleaning 
before  you  leave.  As  you  go  by,  another  employee  calls  to  you,  and 
says  he  needs  help  getting  the  production  equipment  in  operation. 

This  will  not  leave  you  enough  time  to  finish  your  work.  What  would 
you  do? 

(2)  On*  afternoon  you  are  working  on  a  project  for  the  office  manager  that 
needs  to  be  finished  by  quitting  time.  The  Region  Vice  President,  for 
whom  you  also  do  work,  comes  to  you  at  4:30  p.m.  and  hands  you  a  hand- 
written  letter  that  he  wants  you  to  type  and  get  out  in  the  mail  as 
soon  as  possible.  If  you  typ»  this  letter  you  vili  not  be  able  to 
meet  your  dec.'*, line  cr>  tha  project.  What  would  you  do? 

R.i!  situational  interview  differs  from  that  used  by  Chiselli  in  that 
rather  Chan  focusing  on  an  applicant’s  past  behavior,  the  focus  is  on  the 
applicant's  present  goals  or  Intentions.  The  applicant  is  asked,  "What 
would  you  do  if  ...?"  or  "Hov  would  you  deal  with  this  situation?"  Another 
characteristic  of  the  situational  interview  is  that  a  scoring  key  is  devel¬ 
oped  to  illustrate  cr  hunch  mark  1  (poor),  3  (average),  and  5  (excellent) 
answers.  The  bench  mr.rkr.  are  written  in  terms  of  observable  behavioral 
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responses  (e.g.,  1  -  "I'd  stay  home,"  3  -  "I’d  phone  ny  supervisor, "  5  - 
"I’d  cone  to  work*').  Thus  lntcrobserver  reliability  is  facilitated. 

Ghiaelli  himself  was  the  interviewer  using  his  procedure.  Thus,  the  inter¬ 
observer  reliability  of  his  procedure  is  not  known. 

An  advantage  of  Chisel li’c  procedure  is  that  the  information  elicited 
from  interviewees  has  the  potential  for  being  verified  by  former  employers 
who  are  willing  to  answer  straightforward  job-related  questions.  This  is  a 
disadvantage  of  ti.e  situational  interview.  This  problem  is  offset  by  the 
fact  that  the  questions  are  presumably  sufficiently  complex  (as  in  a  case 
study)  that  "gcod"  answers  are  not  intuitively  obvious.  As  a  result  the  per¬ 
son  bain1;  interviewed  stares  his/her  actual  intentions.  This  assumption  is 
supported  by  three  previous  studies  (Latham  et  al.,  1980)  where  significant 
csrrela-.icr.s  were  obtained  between  responses  obtaiueG  to  interview  questions 
and  behavioi  on  the  job.  If  the  "correct  answers"  to  the  questions  were 
transparent  to  the  interviewees,  it  is  likely  chat  a  restriction  in  range 
in  responses  to  the  questions  would  have  precluded  correlations  that  were 
significant.  Every  interviewee  would  have  made  similar,  if  not  identical, 
responses  to  the  questions. 

A  potential  problem  with  Chi-elli’s  approach  is  that  it  may  tend  to 
discriminate  against  people  who  have  not  been  given  the  opportunity  to  engage 
in  certain  behaviors  in  the  past.  This  is  less  of  a  problem  with  the  situa¬ 
tional  interview  becauru  of  its  focus  solely  on  goals  or  intention:..  The 
problem  remains  only  to  the  extent  that  one's  past  experiences  are  so  impov¬ 
erished  that  the  interviewee  has  no  way  of  knowing  how  he  or  she  might  behave 
under  different  conditions. 


7 


In  summary,  it  would  appear  an  interview  procedure  identifying  either 
&  person's  past  behavior:;  or  behavioral  Intentions  can  be  a  successful 
strategy  for  selection.  The  purpose  of  this  paper  is  to  report  the  results 
of  two  studies.,  each  with  a  different  objective. 

The  purpose  of  the  first  study  is  applied  in  nature.  Here  it  was  hypo¬ 
thesized  that  wnat  people  state  they  do  in  an  interview  setting  correlates 
with  what  they  actually  do  on  the  job  as  reported  by  supervisors  and  peers. 

In  addition,  the  advantage  of  asking  what  people  do  rather  than  vhut  they  have 
done  was  compared. 

The  objective  of  the  second  study  was  to  respond  to  the  request  of 
Tenopyr  ani  Ocitje.n  (!9S2)  f'-r  c.  replication  of  Study  3  by  Latham  et  el. 
(19S0).  That  ftudv  ur.ed  a  predictive  validity  design  to  show  that  a  person’s 
intentions  or  goals  expressed  in  r.n  interview  setting  correlate  with  subse¬ 
quent  behavior  or.  the  job. 

SIXTY  1 

Method 

Subjects 

All  29  office  clerical  personnel  in  a  regional  office  of  a  cajor  wood 
products  company  participated  in  this  study.  All  were  females  who  had  worked 
for  the  company  an  average  of  6  years  (SD  °  A. 4).  The  primary  duties  of 
these  people  include  typing,  filing,  and  responding  to  in-coning  telephone 


calls. 
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Procedure 

The  study  involved  three  major  steps:  (1)  the  development  of  a  per- 
formence  appraisal  instrument;  (2)  the  development  of  a  selection  interview 
consisting  of  20  situational  questions  plus  the  5  questions  used  by  Ghiselli 
(1966);  and  (3)  a  concurrent  validation  strategy  conducted  by  correlating 
interviewees*  responses  with  supervisory,  peer,  and  self  assessments  of  per¬ 
formance  on  the  job. 

The  performance  appraisal  instrument  was  develop*  tom  a  systematic 
job  analysis,  r.c.n-.-lv,  the  critical  incident  technique  Ragan,  1954). 

Fifteen  job  incumbents  and  four  supervisors  were  inter  ed  to  ebt3in  the 
critical  incidents  which  were  then  categorized  by  the  authors  into  behavioral 
observation  scales  (EOS;  Latham  &  h'exley,  1981).  The  BOS  defined  nine  job 
dimension.1",  (e.g.,  technical  skills;  interpersonal  skills;  initiative/motiva- 
tion).  Each  scsle  or  dimension  contained  5  to  14  behavioral  items  (e.g.,  can 
type  50-60  words  per  minute;  focuses  on  problems  rather  than  personalities; 
meets  deadlines  with  no  prompting).  A  5-point  Likert-type  scale  (Almost 
Never  -  Almost  Always)  appeared  beside  each  behavioral  item.  Advantages  of 
BOS  as  an  appraisal  tool  have  teen  described  in  detail  elsewhere  (Latham  u 
Wexley,  1981). 

The  situational  interview  va-  developed  by  deriving  20  questions  from 
the  critical  incidents  obtained  in  the  job  analysis.  For  example,  the  follow¬ 
ing  question  was  developed  from  an  incident  that  bad  been  categorized  under 
the  dimension  "Initiative/Motivation”: 

"For  the  past  week  you  have  been  consistently  getting  the  jobs 
that  are  the  most  time  consuming  (e.g.,  poor  handwriting,  complex 
statistical  work).  You  know  it's  nobody’s  fault  because  you  have 


been  sioply  taking  the  jobs  in  priority  order.  You  have  just 
picked  up  your  fourth  job  of  the  day  and  it’s  another  loser. 

What  would  you  do?" 

In  addition  to  the  20  situational  questions,  the  5  questions  developed 
by  Ghiselli  (1966)  were  included  in  the  situational  interview.  The  5  Ghisclli 
questions  are  listed  belov: 

(1)  What  have  you  dona  in  the  past  in  terns  of  experience  and/or  formal 

training  that  is  relevant  to  this  job? 

(2)  Why  did  you  do  it? 

(3)  What  were  your  activities? 

(4)  How  well  did  you  do  it? 

(5)  Why  did  you  want  this  job? 

For  each  of  cbe  25  interview  questions  (20  situational,  5  Ghiselli),  stan¬ 
dardized  bench-marked  answers  (1  -  poor,  3  *  average,  5  -  excellent)  were  devel¬ 
oped  by  the  supervisors  of  the  office  clerical  employees  This  was  done  to 
facilitate  objective  scoring  of  the  responses  by  the  present  authors  who  had 
been  asked  by  the  company  to  conduct  the  interviews.  For  example,  the  bench 
mark  answers  for  the  preceding  situational  interview  question  are:  1  *  Thumb 
through  the  pile  and  take  another  job;  3  -  Complain  to  the  coordinator,  but  do 
the  job;  5  •  Take  the  job  without  complaining  and  do  it.  Also,  as  an  example, 
the  benchmarks  for  the  Ghiselli  question,  "What  have  you  done  in  the  past  in 
terns  of  e:rpcrience  and/or  formal  training  that  is  relevant  to  this  job?"  are: 

1  •  Not  much,  but  enjoy  working  with  people;  3  »  Work  experience  only,  or 
education  only;  5  *  Formal  training  beyond  high  school  and  relevant  work  exper¬ 


ience. 
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Following  the  development  of  the  selection  interview,  each  of  the  29 
office  clerical  people  was  interviewed  by  one  of  the  authors.  The  responses 
were  correlated  with  the  BOS  completed  by  supervisors,  peers,  and  the  job 
incumbents  themselves. 

For  each  of  the  29  employees,  the  BOS  were  completed  by  (1)  her  super¬ 
visor,  (2)  3  to  5  peers,  and  (3)  the  employee  herself.  Supervisory  anpralsals 
were  collected  because  this  is  the  normative  practice  in  this  organisation. 
Peer  appraisal*  ware  collected  because  they  can  provide  a  stable  valid  measure 
relatively  free  of  the  biases  and  idiosyncrasies  of  a  single  rater  (Latham  & 
Wexley,  19S1). 

Self  appraisals  were  collected  despite  the  fact  that  such  appraisals 
nay  lead  to  inflated  ratings.  However,  no  studies  have  used  self  ratings 
with  BOS.  Downs,  xarr  and  Colbeck  (1978)  found  that  when  the  self  appraisal 
"is  confined  to  essentially  behavioural  tests  which  take  place  within  the 
visual  field  of  the  testee  ...,  i.c.,  the  testee  is  visually  able  to  observe 
her  cvn  performance"  (Downs  et  al.,  1978,  p.  276),  self  appraisals  can  be 
val id. 

The  self  and  peer  ratings  were  obtained  in  meetings  with  groups  cf  9  to 
12  office  staff  personnel.  They  rated  themselves  and  3  to  5  co-workers  whose 
names  appeared  on  e  list  given  to  each  individual.  The  peer  ratings  lists 
were  compiled  by  randomly  selecting  Individuals  who  had  frequent  job  contact 
with  one  another. 

The  supervisory  ratings  were  made  by  each  person's  immediate  supervisor 
at  the  same  time  that  the  self  and  peer  ratings  were  being  obtained.  In 
total,  there  were  four  supervisors  who  made  the  ratings.  Everyone  (super¬ 
visors,  job  Incumbents)  received  a  training  course  (L-^hom,  Vaxley  &  Pursell, 


1975;  Puvsoll,  Dossett  «.  Lather.,  I960)  to  help  then  minimise  making  rating 
errors  when  evaluating  others.  The  evaluations  were  made  at  approximately 
the  name  time  the  Interviews  were  conducted.  Ko  one  had  any  knowledge  of 
the  scores  these  people  obtained  iu  their  interview  when  completing  the 
BOS. 

A  concurrent  validity  model  was  used  for  four  reasons.  Pirat,  a  pre¬ 
dictive  validity  model  was  not  possible  due  to  the  small  number  of  job  open¬ 
ings  that  occur  in  this  organisation  on  a  yearly  basia.  Second,  the  American 
Psyche  logit  si  Ar.-oc-  division  of  Inc«..  ^rial-organisation.*!  F  •••,  .rhology 

(19dl)  Principle-  fei  Selcctirn  Procedures  state  explicitly  that  concurrent 
studies  provide  useful  eotimcres  of  validity.  Barrett,  Phillips  cad  Aleron- 
der  (1981)  have  gr  own  that  not  only  has  the  conceptual  distinction  between 
predictive  ora  eonturrenc  validity  been  exaggerated,  but  more  importantly, 
"the  differences  the.  r.jy  1st  have  never  been  shown  to  render  concurrent 
validity  ir.accur-ri  as  a;,  estimate  of  predictive  validity...  theso  differ¬ 
ences,  if  present,  have  a  minimal  impact  on  the  magnitude  of  an  obtained 
validity  coeff  Jrl-.nt"  (lerrett  r-t  el.,  I9dl,  p.  1).  Although  Barrett's  work 
was  restricted  to  cognitive  ttstr,  previous  work  using  the  situational  inter¬ 
view  showed  that  partialling  out  experience  did  not  affect  the  magnitude  of 
the  correlation  coefficient  (Latham  et  al.,  I960).  Finally,  and  most 
importantly,  this  stu-y  was  applied  in  nature.  We  were  not  interested  in 
show!  unidirectional  ci.vsnliry,  needy,  that  intenrirns  affect  behavicr. 

The  aoln  purpose  cf  this  study  vjs  to*  determine  whether  a  relaiiomhip  exist? 
between  what  is  said  In  an  irtr.’-vi c-w  end  what  is  dene  on  the  job.  Such  a 
relationship,  if  St.  exists,  would  be  of  major  importance  to  employers  regard- 
loss  of  sr-un  -cions  of  causal'. ty.  In  this  respect  the  study  is  interactional 


in  nature  (Terborg,  2931)  in  that  it  recognizes  that  behavior  i6  the  func¬ 
tion  of  a  continuous  process  cf  the  multidirectional  interaction  between 
the  Individual  and  i;he  situation  encountered. 

Results 

Tr.e  near.:  ,  ptardard  deviations,  end  internal  consistencies  of  the 
Ghiselli  questions,  situational  interview  and  BOS  completed  by  supervisors, 
peers,  and  job  incumbents  are  shown  in  Table  1.  The  intercorrelations  among 
the  rater  groups  arc  s!  uwn  in  Table  2.  The  supervisory  a:ic  peer  ratings 
correlated  significantly  with  one  another. 

Insert  Tables  1  and  2  about  here. 

The  correlation  between  the  Chiseili  items  end  the  situational  interview 
was  .15  (n.s.).  The  correlation  between  each  interview  procedure  and  the  EOS 
is  shown  in  Table  3,  .'.long  with  'Multiple  R  values.  Only  the  situational 
interview  cc rrelcteu  significantly  vith  supervisory ,  peer,  rid  self  ratings 
of  job  performance.  Chiseili' s  procedure  correlated  significantly  only  with 
self  trti nys  ov  rurforr.rrice .  h’hen  job  experience  was  parti  -  lleo  out,  none 
of  the  'orrelrtions  chsr.se-!  significantly. 

Ir.ser;  Table  3  about  here. 

In  order  to  further  examine  the  relative  contributions  of  the  situa¬ 
tional  Interview  r.nd  the  Chiseili  questions,  multiple  regression  equations 
ware  calculated  using  a  hierarchical  method.  When  the  situational  interview 
responses  were  entered  first  into  a  multiple  regression  equation,  followed 
by  the  responses  to  Chiselli's  questions,  the  amount  of  variance  accounted 
for  in  each  of  the  dependent  variables  (supervisory,  peer,  and  self  ratings) 
did  not  increase  significantly  over  that  accounted  for  by  the  situational 
interview  alone.  However,  when  the  reverse  was  done,  the  increase  in  the 
amount  of  variance  accounted  for  by  the  aituationsl  interview  was  signifi- 


cant  (p  <  .05}  for  each  of  the  dependent  variables. 

Discussion 

The  significance  of  this  study  is  threefold.  First,  the  results  of 
the  situational  Interview  show  that  there  is  a  relationship  between  goals  or 
intentions  expressed  in  an  interview  and  behavior  on  the  job.  That  goals 
correlate  with  benavior  is  among  the  most  robust  findings  in  the  psycholog¬ 
ical  literature  on  moti-Micr  'l-i-clte,  Shaw,  SaarJ.  i>  lathes,  19S1).  This  is 
the  fourth  tint  this  iinding  haa  been  found  to  be  applicable  to  the  id“C- 
tion  literature.  Latham  et  al.  (198?)  found  support  for  intentions  corres¬ 
ponding  to  behavior  vith  two  groups  of  entry  level  employees  as  veil  as 
first-line  supt-rvirseri  .  Job  experience  was  not  found  to  moderate  thi9  rela¬ 
tionship.  The  present  study  has  replicated  these  findings  with  clerical 
employees. 

Second,  8ignificant  uerrelatioits  vith  performance  measures  were  obtained 
in  this  and  the  three  previous  interview  studies  (Lathcm  et  al.,  1980) 
despite  the  use  of  ".*11  sample  sites  (i.e.,  *9,  63,  56,  and  29,  respectively) 
We  Ksli-we  that  ch-f.e  outer*. ->  occurred  by  adhering  to  Warnimont  and  Ccnp- 
bcll’a  (1968)  plea  to  develop  predictors  that  rr&  not  only  realistic  samples 
of  behavior,  but  ar.'  on  similar  to  the  criteria  as  possible.  In  these 
studies  the  performance  criteria  consist  of  observable  behaviors  derived 
from  a  job  taa) >-*!«:.  The=  interview  questions  are  derived  from  the  same  job 
analysis.  The  interview  questions  tap  behavioral  intention*. 

Third,  and  tb*  major  finding  of  the  study,  waa  that  the  situational 
interview  was  found  tc  better  correspond  to  Job  performance  than  Chisclli'a 
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Interview  which  assesses  past  experiercec.  This  is  encouraging  from  the 
standpoint  of  affirmative  action  politics  whereby  an  emphasis  on  a  parson's 
past  could  lead  to  selection  decisions  that  adversely  lap act  certain  groups 
of  people.  Previous  studies  have  shown  that  the  situational  interview  can 
predict  the  job  performance,  of  both  females  and  blacks  (Latham  et  cl., 

1980) . 

f'TUDY  2 

A  liff.1  -..arlon  of  Studv  1  anu  two  oi  the  three  studies  that  preceded  it 
(Latham  et  al.,  IS?.'*)  is  the  use  of  a  concurrent  validity  design.  The 
design  precludes  assunpt loii?  regard-us  unidirectional  causality.  The 
theoretical  rationale  ct  the  situational  interview  is  that  a  person's  goals 
or  intentions  predict  subsequent  behavior  on  the  job.  Thus  from  a  theoreti¬ 
cal  standpoint,  a  predictive  validity  strategy  must  be  used.  Only  one  of  the 
three  studies  conducted  previously  by  Latham  ct  al.  used  c  predictive  valid¬ 
ity  design,  ar.d  that,  because  of  its  small  satnple  sire,  needs  replication 
(Tencpyr  Ocltjen,  1922' . 

A  potential  limitati'n  of  the  first  study  reported  here  is  the  poten¬ 
tial  problem  oi  l«.cV  cf  independence  among  the  varicu*;  sources  of  data  and 
instrument  detelopuvnt.  Job  if.cumbr.nts  were  the  source  of  critical  inci¬ 
dence,  peer  rstvur.s  and  pelf  ratings  as  well  as  statexents  of  behavioral 
intentions. 

From  a  rational  standpoint  this  issue  was  not  a  problem.  No  Bert  than 
five  incidents  warn  collected  from  one  individual.  It  is  unlikely  that  these 
fivo  incidents  would  provide  a  cenpr ;heosiva  dos  ription  of  the  behavioral 
domain  of  this  one  i  'dividual.  The  appraisal  instrument  was  bassd  on  a 


composite  of  the  collected  Incidents.  Nevertheless,  a  predictive  validity 
study  would  provide  empirical  data  regarding  both  Issues:  causality  and 
independence  of  measures.  Thus  the  following  study  was  conducted. 

Method 


Sample 

Entry  level  utility  people  (n  *  349)  were  recruited  for  work  in  a  news¬ 
print  mill.  The  mill  was  being  started  up  for  the  first  time.  The  appli¬ 
cants  were  recruited  from  across  the  United  States.  Of  the  349  people  inter¬ 
viewed,  15?  were  hired.  Ine  mean  age  of  the  two  groups  was  29.76  (SI)  ■ 

7.56)  and  2S.51  (SD  “  6.82),  respectively. 

Procedure 

Hiring  decisions  were  based  primarily  on  recommendations  and  the  mill 
manager's  knowledge  of  the  applicant's  reputation  in  the  industry.  Thus  an 
opportunity  was  available  to  conduct  a  predictive  validity  study  using  the 
situational  interview. 

The  Interview  and  bench  marks  were  developed  by  the  company's  personnel 
department  and  lin*  superintendents  independently  of  the  authors.  The  inter¬ 
view  consisted  of  21  questions.  The  interview  was  conducted  by  two  to  three 
people  (at  least  one  superintendent  and  one  person  from  personnel) .  The 
interview  answers  were  scored  Independently  by  the  interviewers.  Upon  com¬ 
pleting  the  scoring,  discussion  was  held  until  consensus  was  reached  on  an 
overall  score  for  the  applicant. 

Three  years  later,  the  present  authors  were  asked  to  develop  BOS  for 
appraisal  purposes.  The  five  job  dimensions  were  safety,  work  habits,  job 
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knowledge  end  ability,  interactions  with  peers,  and  interactions  with 
supervisor. 

First  line  supervisors  received  training  (Latham  et  al.,  1975;  Pursell 
et  al.,  1980)  cm  objectivity /accuracy  in  making  appraisals.  None  of  these 
people,  including  the  authors,  had  knowledge  of  a  job  Incumbent's  score  on 
the  situational  Interview  three  years  eerller.  The  first  line  supervisors 
completed  the  BOS  on  the  utility  people. 

Results 

Tab.!e  4  shows  the  internal  consistency  and  the  intercorrelations  among 
the  BOS  measures.  Table  5  shows  the  mean  BOS  scores  using  a  0  -  4  point 
scale.  The  applicants  (n  »  349)  performed  no  differently  on  the  situational 
Interview  (X  *  80.02,  SD  «  12.17)  than  did  the  people  who  were  subsequently 
hired  (n  **  157,  X  -  81.25,  SD  -  12.56). 


lmcrt  Tables  4  ana  5  about  here. 

The  correlation  between  performance  in  the  interview  and  subsequent 
performance  on  the  Job  was  significant  (p  <  .05)  ss  assessed  by  the  composite 
BOS  (r  -  .14). 


Discussion 

This  study  is  the  fifth  in  a  series  of  investigations  to  determine 
whether  there  is  a  relationship  between  what  is  said  in  the  interview  and 
what  is  done  on  the  job.  Two  studies  including  the  present  one  have  shown 
that  intentions  affect  behavior.  This  is  not  to  deny  that  subsequent  behav¬ 
ior  can  and  will  affect  future  intentions.  It  simply  shows  that  present 
Intentions  do  in  fact  predict  nubsequent  behavior.  Thus  study  3  of  Ls thorn 
•t  al.  (1980)  has  been  replicated. 
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A  factor  unique  to  the  fifth  study  is  that  tha  situational  interview 
was  developed  and  conducted  independently  of  the  authors  by  the  sponsoring 
company.  That  the  correlation  is  primarily  of  theoretical  significance 
only  is  a  function  of  the  high  quality  workforce.  Consequently  there  was 
a  severe  restriction  of  range  in  the  performance  appraisal  scores.  This  is 
because  an  attempt  had  been  made  to  identify ,  on  the  basis  of  reputation  in 
the  industry,  the  very  best  people  and  then  to  recruit  them.  That  the 
effort  was  successful  is  evident  by  the  number  of  people  who  have  been 
terminated  —  two. 


we 
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TABLE  1 


Mt  aus.  Standard  Deviation? ,  and  Internal  Consistencies 
of  Ghiselli  Interview,  Situational  Interview 
and  Pc rt ur.aance  Measures 
(ti  -  29) 


z  r:n 

Standard 

Deviation 

Reliability 

(Crcnbach's 

alpha) 

Ghiselli  interview 

19.27 

3.48 

.55 

Situational  interview 

72.89 

9.11 

.73 

Supervisor  ratings 

252.67 

28.59 

.96 

Peer  ratings 

256.40 

25.03 

.96 

Seif  ratings 


266.18 


15.07 
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TABLE  2 

Intercorrelations  of  Supervisor,  Peer  and  Self  Ratings 
Using  Behavioral  Observation  Scales 
•IN  ■  29) 


Self 

Supervisor 

S’jif'rvisor 

.29 

— 

Fee- 

.12 

J2* 

'  .05 
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Situational 
Ghiseiii  it 
Multiple-  " 

*p  <  .05 

**p  <  .01 


TABLE  3 

Validity  of  Situational  Interview  Versus  Ghiselli  Items 
vith  Supervisor,  Self,  and  Peer  Ratings 
(N  *>  29) 


Supervisor 

Peer 

Self 

int<?  rviev 

.39* 

.42* 

.50** 

:!T1S 

.14 

.15 

.40* 

o 

• 

.43 

.60** 
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TABLE  4 

The  Internal  Consistency  of  the  Performance  (BOS)  Measures 


Reliability  Intercorrelations 


Category 

(alpha) 

1 

2 

3 

4  5 

1.  Safety 

.84 

2.  Work  habits 

.89 

.61 

3.  Job  knowledge  and  ability 

.84 

.58 

.61 

4.  Interactions  with  peers 

.91 

.50 

.69 

.45 

5.  Interactions  with  supervisor 

.82 

.53 

.77 

.66 

.66 

6.  Composite 

.86 

.73 

.88 

.79 

.81  .91 
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TABLE  5 

Criterion  Statistics  for  BOS  Croup 


Ci :  u  rion 

X 

SO 

n 

BOS 

1 

Sati ty 

3.56 

.30 

16/ 

BOS 

2 

Work  Habits 

3.60 

.36 

167 

BOS 

3 

Job  Krirwledfo 

3.39 

.49 

167 

BOS 

4 

Peer  Interactions 

3.50 

.54 

10  7 

BOS 

5 

Interaction.  with  Supervisor 

3.22 

.66 

166 

BOiTC? 

Composite 

3.46 

.40 

167 
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